Boltzmann Machine and Hyperbolic Activation Function in Higher Order Network
نویسندگان
چکیده
منابع مشابه
Boltzmann Machine and New Activation Function Comparison
Boltzmann machine and new activation function are examined for its ability to accelerate the performance of doing logic programming in Hopfield neural network. Boltzmann machine has a higher capacity than the new activation function. This learning rule also suffers significantly less capacity loss as the network gets larger and more complex. Comparisons are made between these rules to see which...
متن کاملTowards higher order lattice Boltzmann schemes
In this contribution we extend the Taylor expansion method proposed previously by one of us and establish equivalent partial differential equations of the lattice Boltzmann scheme proposed by d’Humières [11] at an arbitrary order of accuracy. We derive formally the associated dynamical equations for classical thermal and linear fluid models in one to three space dimensions. We use this approach...
متن کاملHigher Order Logic Programming in Radial Basis Function Neural Network
Intelligent systems are yielded from integration of a logic programming and connectionist systems. Radial basis function neural network is a commonly-used type of feedforward networks. In this paper, we proposed a method for connectionist model generation using Radial Basis Function neural network to encode higher order logic programming. We encode each clause from the clauses of a logic progra...
متن کاملLearning in higher order Boltzmann machines using linear response
We introduce an efficient method for learning and inference in higher order Boltzmann machines. The method is based on mean field theory with the linear response correction. We compute the correlations using the exact and the approximated method for a fully connected third order network of ten neurons. In addition, we compare the results of the exact and approximate learning algorithm. Finally ...
متن کاملRestricted Boltzmann Machine and its High-Order Extensions
Deep Neural Network pre-trained with Restricted Boltzmann Machine (RBM) is widely used in many applications. However, it is quite tricky to extend RBM to have high-order interactions. Its dependence on the choice of parameters and hyper-parameters such as the number of hidden units, learning rate, momentum, sampling methods, number of factors, initialization of factor weights makes it pretty di...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Modern Applied Science
سال: 2014
ISSN: 1913-1852,1913-1844
DOI: 10.5539/mas.v8n3p140